Papers with visual grounding of colour terms
Knowledge Supports Visual Language Grounding: A Case Study on Colour Terms (2020.acl-main)
Copied to clipboard
| Challenge: | In human cognition, world knowledge supports the perception of object colours . a lot of recent work in Language & Vision has looked at grounding language in real-world sensory information. |
| Approach: | They propose to integrate visual information and object-specific knowledge via hard-coded or learned fusion to improve visual grounding of colour terms in realistic objects. |
| Outcome: | The proposed models outperform a baseline model that predicts colour terms solely from visual inputs but show interesting differences when predicting atypical colours of so-called colour diagnostic objects. |